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ABSTRACT 


The extent to which 36 schools darticdtuabang in the 
North vest Reading Consortium adhered to the use of the Right to Read 
assessment and planning procedure as a means of identifying and 
_ implementing needed imprevemerits in their reading programs is . 
analyzed in this report. The report concludes that there was a high » 
correlation between use of the Right to Read procedure and selection 
and implementation of reading improvement programs in schools where 
the procedure was faithfully appliéd, where the principal took an- 
active léadership role in the task force meetings, where the. q 
building-based task force had the support of the district 
administration, and where conditions fof change and improvement were 
generally positive. (FL) 
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‘ ee AN ANALYSIS OF PROGRAM SELECTION 
USING THE RIGHT TO READ PROBLEM SOLVING PROCESS 
One of the eiieorives of the Northwest Reading Consortium (NRC) was 
to assist 36 public schools in four states in the selection of an appro- 
priate Research and Development (R&D) *pased innovation to improve reading 
programs. It was a stated goal ef the Project 2 irs not’ only the “ee 

of R&D reduten but the process of change itself.’ To accomplish these 
routs the NRC used the Right to Kead (R2R) assessment ead planning . 

_ procedures as the problem-solving process model. The Right to Read 
Assessment and Planning Handbook was designed as a program review and 
planning guide (distributed by Seen) for use by a committee/or task ’ 
force for collecting—data arid making decisions About reading ere 
The pretact model also prescribed the review of a data bank called the 
Knowledge Base in the program selection process. (This data bank is a: 
compendium of printed summaries and collections of research based reading 

-materials and methods validated by the NRC and compiled by the Northwest 

; a 

Regional Educational Laboratory.) Serious review of the Knowledge Base ~~ 
is defined as consultant and/or building task force stydy of program 
descriptor sheets, and subsequent study of program overviews, teacher 
guides, sample materials and evaluation data for several selected programs. 

; @f, after Eollopeny these procedures, a task force was unable to find a 

match between its seleccion criteria and ‘a Research and Development 
innovation, further Project support of activities was contingent upon 

either approved program evaluation bras as a means of validating an 
alternative or additional Santis €0 aspects of the problem having 
potential for research and develppment solutions. ig awek state an 
educational: consultant or facilitator worked closely with each site in 


\ 


the four phases of the Projegy: problem identification, solution selection, 


. 


implementation planning and, {installation of the innovation selected. 


It°is the intent of this paper to analyze the fidelity to this model 
through the solution selection phase of the curriculum change process. 
Adherence fin the Model 

The first question is: Did the schools follow the model described | 
stove? This analysis showed that 44% of the schools adhered to the 
prescribed solution selection process throughout the planning cycle and 
56% did nat A site's "adherence" to the model was assessed by review 
of the educational facilitator's documentation of his/her activities and 
also ig dekocnet fekecybewtst project staff who had visited the schools 
and worked’closely With the facilitator. The 1aeter process indicated 
that the €ompletion of the required documentation of the problem-solving , 
process and of Right to Read charts was a pro forma compliance for a few 
sites and lacked the facilitator's or task force's commitment to both 
using the Right to Read sides and seriously considering the Knowledge 
Base a materials. Thus the definition of "adherence to the model" is 
used herein to include onl¥ those schools who adhered to both the "spirit 


: 4 
s 
_and the lettet'' of the model described above. 
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Of the 21 sites who were judged as not adhering to the model, only three 

or 15% seleenal a validated Research and Development program: whereas, 

af ewes who were seen as adhering to the model 12’ or 75% selected 

research based es eee innovations. A’ Chi Square test of the relationship 
between adhering to the Project model and selecting an R&D innovation 

showed a statistically significant difference in solution selection 

between those who adhered to the model and those who did not (p.<.01). 

Such a ide Vetentanahie between the combined use of the proposed group 
problem esting process and the Knowledge Base and the a eeniae selection 


of a validated R&D innovation supporte the use of this model in R&D 


@ 
utilization programs. Although many hypotheses might be offered to 


ad 


explain the’ relationship between following thts model and selecting an 
‘ 2-8 ® , { 
R&D program, it apReAte more complex than a simple ‘linear or pastel 


; 
pelarionente: The success of this’ mode] in oe Ene ‘user to an R&D 
innovation can only be interpreted within ,the total context of this © 
A ji E e % Y A . , . ie ; : =a 
Project, where. adherence to.the model was not as widespread as anticipated 


in project plans. ° j | oe, . a4 ; 
Fifty+six percent of | the ee schools‘ adhered to, the model; 
whereas, at the junior and senior high seteol. level - the Seonpvedone: were 
30% and. 38% seapeoetveay: In addition to cheswoparann differences in |. 
organizational structure at the secondary jevutas oné ‘possible Bia 
tation of the varied success of the isle GAT Perea educat sonal | 
levels might reflect the difference in attitudes ‘toward ‘the teaching of 
‘reading and dite we in reading skills of concern at the sieneubary. 
versus sichuaceda seiner, Though the differences were not significast, 
the tind wangeate the hypothesis that the R2R eee — more adaptable 
at the eleméntary level than at the junior and senior high levels. The 
lack of applicability of this assessment process at the secondary level 
was conf irmed informally by our esalidcanere. ante of whom developed ihe 
own alternative handbook for use at the secondary level. Similarly, the 
research and development programs seemed: ceuesfiat more frequently selected 
. elementary sites (56%) than by junior highs (10% selected research, 
based PROpramn?. At the senior high level although 50% of the schools 
selected eabeatth based programs, only one of these was from the project's 
validated knowledge base. The other R&D selections‘ made by high schools 
were found via searches bern ene project's knowledge base of programs. 
Another aspect of fidelity to the model which is worthy of investi-’ 
gation is at which point the ptocess did not work. The Right to Read 


process was claimed to be cumbergome and time consuming by some of the 
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ask forces. Do the program selection criteria developed during this . 
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process provide any clue to the site*s eventual difficulties in meeting 

the -expéctations of this model? The selection criteria were, in retrgSpect, 
judged "adequate" at 61% ae the sites, and "too general" or non-existent 

at 39%. Perhaps a more thorough bre-sabeceuent of readiness for this 

type of een solving and change peaiaaaie been dercatueng in some 

of the Anstances where criteria for a program to be selected were not _ 
clearly stated before a selection was ae, While group problem-solving 

is designed to provide a wide range of involvement of staff, it may be 

an alien process in many schools. Schools may aad help in becoming. 

ready for change. Skills in instructional siaindes by staff may be more 


. limited than at first realized. : 


. 


The Relationship of Selected Factors to Fidelity to ‘the Model 


Me there common characteristics of the schools which did not 
adhere to the Project model (Ne21)? In only 4 of the 21 sites (19%) 
which did not follow the model did the school principal assume an 
‘active leadership role in project activities. Whereas, in etree which cP 
adhered to our process model the principal was in an active leadership 
position with the task force at 9 or 60% of the schools. In more than 
half of the cases where ‘the principal was not actively involved in 9 
project’ activities the leadership was provided by a district level 
person cathe? than a building level person. In those cuage it was not 
uncommon for the district level leader to make decisions regarding 
curriculum. changes wide appeared to ignore the activities of the planning 
group eetceuaa primarily is teachers. It was extremely rare that«a 


* . 
district level pergon assumed a leadership role yet encouraged the group 


to come to a decision concerning the nature of the problem and the 


program to be adopted. With district leadership often came constraints. 
Cooperative leadership with district and building persons working with 

‘the idnker (faxspedater’ vam. ebbdent in 7 of the 36 elas one third of Tek. 
the sites which followed our model had such shared leadership and in all J 
bu one of those schools the principal was the task force chairperson. 

Thus, the role of the principal appears to have been crucial in the 

success of this project. Since the bate model calle. for school-based » 


. 4 ‘ 
task farces and documentation, it is clear that district level decision- 


ss 


making is not in conformity with this model as applied by the NRC. In 
one district efforts to set up building task pices watts never successful; 
aid the district-selected solution was chosen prior to entry into the 
project and applied to all ee in that district. The district 
influence in decision-making at the building level is clearly significant 
as a factor differentiating these nebpols from sites which followed the 


Project model. 
\ S 
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The Climate at the Project Sites ’ ‘ 


A deewiied analysis of the climate at project sites indicated that 
most of the sites were plagued by some adversity such as levy failure, 
budget problems, key personnel transfer ha! weatansehons teacher-union 
conflict or ee organizational or interpersonal conflicts within the 
school district. 

* 47% had levy failures just. prior to or during the Project contract. s 


* 72% had turnover in key personnel during the Project (pr ncipal, ° 


superintendent, facilitator or key school contact person with ~« 


Project). 


A 


* 55% had principal documentation of "community pressure as an impor- 
tant push to action in dealing with the problem.” 

* 44% had principal documentation of new laws as an important push) to 
action. | 

* 92% of the sites Had weak dixodueupeiiey legislation which was 
viewed by the field consultant as bearing on Project activities (in 
the form of student learning er a graduation competencies, 
or assessment for accreditation or emerging legislation). 


No pattern, or interaction of the above adverse "conditions" could 
Be isolated itt differentiated the sites not adhering to the model 
from those which followed the model. Thus, the prevalence of situations 
such as high personnel turnover, or levy failure and subsequent budget 
problems should not be considered sufficient reason to deny a site 
participation in an instructional improvement project. It may well be 
that such a climate of adversity is common in schools today and is not 
unique to the experience of this project. On the other hand, neither 
should factors such as accountability legislation, retg#ased time for 
teachers’ to work on task forces, community pressure to {mprove programs, 
the services of an educational facilitator, money or a data bank of R&D 
programs be considered sufficient conditions for influencing a school to 
adhere to a prescribed process of problem solving. 

Further efforts to analyze fidelity to this model include a look at 
the type of selections made by those not adhering to the model. Eight 
at 2} selected inservice, six selected a basal, five made no selection 
and 2 mice adopted other non-research based programs. Thus the rationale 


for inservice and staff development was in some cases that it met a more 


basic need of the site which may be preliminary to eventual selection. of 
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a research and development based reading program. If this is true, we 


are again faced with the problem of how to identify sites prior to their 
entry into such a contract so dink anaes of the capacity building or 
awareness type can be offered. Considerable exploration of bigndtanceauce | 
of the assessment of etadtnenk emerged from this project's experience. 
See ‘tiead these for Instructional Improvement Planning Through Group 
spits Solving Approaches" by Albert R. Haugerud. Several seqoridney 
schools which selected inservice were dealing with veading the content 
areas. The project data base was considered by che tandidemenes to be 
ineufficient in this problem area. : ’ 

What are the characteristics of the sites yhich never made any 
selection at all (N=5)? At three sites internal district-level problems 
and teacher-union problems have béen present; yet, "adequate" criteria 
were developed. Gaui problem-solving in curriculum development at the 
building level was a low priority at those sites. One other site nee . 
making a selection shine ticee years did develop "adequate" criteria, 
but lack of principal commitment to the Project was viewed by the facili- 
tator as "the problem" holding up the process. At the fifth site the 
district did not appear to want eT er ee and neither did the 
principal. Thus it seemed that key gatekeepers were able to prevent 
project intervention. As was aptly summed up by Richard Carlson in his 
project report, 

"Revealed by the difficulties in obtaining project fidelity 
and the reasons offered for lack of fidelity are (a) the 
fidelity requirements, if mét,.demand a chang¢ in the usual 
composition of school decision makers, a change in the manner 
‘in which decisions are made, and a change in the type of 
solution accepted -- a change from commercial to research and 
development solutions, and (b) much resistance was mounted to 


these fundamental changes, and much activity was aimed at 
stability maintenance." 


Ph 
The socio-organizational dynamics of the district must be taken 

into account prior to entry. The-€onflicts present and the resistance 
to change may-need to be dealt with prior to inktodadtan data bank or 
a prescribed selection error: This was borne out by data Sitaecei 
during the Airset phase ‘of the project. An assessment of the climate for 
change was made by, the Linker (faciliator) at the eine of the problem 
identification and setting of goals and objectives, prior 5 the Selection 
of a program, The schools’ ratings on the following two statements were 
sie sebas | 

1. "Those involved iuicaans what is going on and what needs to 


o 


be done." 
2. "Those who. are involved are committed to plans for makita 
_ improvements in reading instruction successful." 

The average rating on Statement 1 (Understanding) was higher for 
sites which pice inter judged to adhere to the: prescribed model than for 
those who did not follow the model. So too, commitment to plan seemed 
greater at sites which followed this instructional planning model than 

_at these sites with apparently conflicting agendas, timelines and 
priorities. More intervention to clarify projett dnvobvanent through 
assessing and facilitating readiness at an earlier date might have been | 

: ’ 
helpful. Had the research structure of the project not been to test a 
specific planning model, greater flexibility in readiness activities 
might have prevailed. Some ree this direction were made through 


the training’ efforts of the NWREL staff, but more extensive dialogue and 


diagnosis prior to entry is needed. The reader is referred to the paper 


', on Readiness cited above. 
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Success in group instructional planning or improving reading programs 
~ : ; at 


cannot -be measured only by strict adherence to all aspects of this 
model. The broader impact of this project can be seen in the numerous 


innovations adopted by participating schools. In total, 48 programs x 


" were adopted by 31 schools to solve their identified problem. Thus 86% 


i: the schools implemented sone program through participation ere 
af ae my) 
projéct. Thase innavations which were not research-based were often the 
most time consuming to plan al possibly the most appropriate solutions 
_ din seg age The rationale for the selection of a non R&D innovation 
ere the teachers' negative attitude towards redttarch and positive 
attitude towards solutions "seen in operation" in other schools. A 


feeling of "uniqueness" was expressed by some. task forces, referring to 


their situation as not being amenable to a packaged solution and needing 
] a WB man < 


] a a 
a tailor-made program for theif specific needs. In those cases new 
materials, and training programs were often developed to meet specific 
needs. Such total involvement of teachers in developing their own 


curriculum served to intensify the teachers' commitment when implementation 


s* 
began. — o of 
Summary and Implications . 4 


Fidelity to the model of using the Right to Read assessment procedures ~~. 
and reviewing a selected group of R&D programs (thé Knowledge Base) was 
not widespread - 56% of the schools did not adhere to this model. Yet, 
whare adherence to the. model was evident, selection of an R&D program ; = 
followed in 75% of the sites. This indicates the appropriateness of 


this model as one vehicle leading to the implementation of R&D. programs 


in the schools. Caution is a ne ae this relationship, 


< 
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as the inability of 56% of, the sites to follow this model coexisted with 
bo human, technical and financial sige whieh influenced other 
institutional phanning pee witoes. We might conclude that group problem- 
solving ¢annot be forced or easily eee yet, vechabe the road can be | 
pata for it if timelines and goals can be meshed. We can concur sete 
“the recent findings of the Rand acudy (p. 14) that the selection process 
does ek eeaniat of a "rational weighing of alternative sidwattonat 
treatment... We cannot,offer any simple model of this selection process." 
In an, atmosphere of conflicting presnuree to change with various pe ee 
tional, sovalebeat dnd: taverpeteonal acneliets prevailing in school 
Pre oe the ability or motivation of any broup to make a decision 
using a prescribed process and a specific set of instructional choices 
becomes aiffichie without more preparation,- capacity building, or staff 
awareness prior to aca the problem feminine So too, the J 
intervention by an outside person through the district office seems to 
take different forms which lead to varied success. In cases where the 
principal oer a lesderstite role with the district's "blessing," the 
group problem solving process was more likely to be followed than in 
Sieeets where the district llevel contact person assumed a leadership 
_ role. ~Yet analysis of the: issues suggested that the potne in time when 
adherend to the model might’ have been indicated ie ptobably setae to 
entry into the project. Certainly the seeds of failure to pursue R&D 
/ 
outcomes were evident at the time of developing a problem sitpence 
Fidelity to this model appears to be a function of a cemplex array of - 


factors related to both the limitations of the model itself and the 


timelines, priorities, and leadership of those ‘being served. 
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